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ABSTRACT 

We consider a switched network, a fairly general constrained 
queueing network model that has been used successfully to 
model the detailed packet-level dynamics in communication 
networks, such as input-queued switches and wireless net- 
works. The main operational issue in this model is that 
of deciding which queues to serve, subject to certain con- 
straints. In this paper, we study qualitative performance 
properties of the well known a-weighted scheduling policies. 
The stability, in the sense of positive recurrence, of these 
policies has been well understood. We establish exponential 
upper bounds on the tail of the steady-state distribution of 
the backlog. Along the way, we prove finiteness of the ex- 
pected steady-state backlog when a < 1, a property that 
was known only for a > 1. Finally, we analyze the excur- 
sions of the maximum backlog over a finite time horizon for 
a > 1. As a consequence, for a > 1, we establish the full 
state space collapse property |17lll8j . 

1. INTRODUCTION 

This paper studies various qualitative stability and perfor- 
mance properties of the so-called a-weighted policies, as ap- 
plied to a switched network model fcf. |22l (TSj ). This model 
is a special case of the "stochastic processing network model" 
(cf.[10)). which has become the canonical framework for the 
study of a large class of networked queueing systems, in- 
cluding systems arising in communications, manufacturing, 
transportation, financial markets, etc. The primary reason 
for the popularity of the switched network model is its abil- 
ity to faithfully model the behavior of a broad spectrum 
of networks at a fine granularity. Specifically, the switched 
network model is useful in describing packet-level ("micro") 
behavior of medium access in a wireless network and of the 
input-queued switches that reside inside Internet routers. 
This model has proved tractable enough to allow for sub- 
stantial progress in understanding the stability and perfor- 
mance properties of various control policies. 

At a high level, the switched network model involves a col- 
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lection of queues. Work arrives to these queues exogenously 
or from another queue and gets serviced; it then either leaves 
the network or gets re-routed to another queue. Service at 
the queues requires the use of some commonly shared con- 
strained resources. This leads to the problem of scheduling 
the service of packets queued in the switched network. To 
utilize the network resources efficiently, a properly designed 
scheduling policy is required. Of particular interest are the 
popular Maximum Weight or MW-a policies, introduced in 
[22j . They are the only known simple and universally appli- 
cable policies with performance guarantees. In addition, the 
MW-a policy has served as an important guide for design- 
ing implementable algorithms for input-queued switches and 
wireless medium access (cf.[l4l[2TJ[8l[7l[T6]). This motivates 
the work in this paper, which focuses on certain qualitative 
properties of MW-a policies. 

Related Prior Work. 

Because of the significance of the a-weighted policies, there 
is a large body of research on their properties. We provide 
here a brief overview of the work that is most relevant to 
our purposes. 

The most basic performance question concerns through- 
put and stability. Formally, we say that an algorithm is 
throughput optimal or stable if the underlying network Markov 
chain is positive recurrent whenever the system is under- 
loaded. For the MW-a policy, under a general enough stochas- 
tic model, stability has been established for any a > (cf. 

[Ill [13 nil]). 

A second, finer, performance question concerns the evalu- 
ation of the average backlog in the system, in steady-state. 
Bounds on the average backlog are usually obtained by con- 
sidering the same stochastic Lyapunov function that was 
used to prove stability, and by building on the drift inequal- 
ities established in the course of the stability proof; see, 
e.g., [5]. Using this approach, it is known that the average 
expected backlog under a-weighted policies is finite, when 
a > 1 ([H]). However, such a result is not known when 
a € (0,1). 

An important performance analysis method that has emerged 
over the past few decades focuses on the heavy traffic regime, 
in which the system is loaded near capacity. For the switched 
model, heavy traffic analysis has revealed some intriguing 
relations between the policy parameter a and the perfor- 
mance of the system through a phenomenon known as state 
space collapse. In particular, in the heavy traffic limit and 
for an appropriately scaled version of the system, the state 
evolves in a much lower-dimensional space (the state space 



"collapses"). The structure of the collapsed state space pro- 
vides important information about the system behavior (cf. 
[Ill 1171 nS] ). Under certain somewhat specific assumptions, 
a complete heavy traffic analysis of the switched network 
model has been carried out in [191 However, for the 
more general switched network model, only a weaker result 
is available, involving a so-called multiplicative state space 
collapse property [181 117| . State space collapse results are 
related to understanding certain transient properties of the 
network, such as the evolution of the queues over a finite 
time horizon. To the best of our knowledge, a transient 
analysis of the switched network model is not available. 

A somewhat different approach focuses on tail probabili- 
ties of the steady-state backlog and the associated large de- 
viation principle (LDP). This approach provides important 
insights about the overflow probability in the presence of fi- 
nite buffers. There have been notable works in this direction, 
for speciflc instances of the switched network model, e.g., 
[20] . In a similar setting, the reference [T^ has also estab- 
lished a LDP for the MW-1 policy, using Garcia's extended- 
contraction principle for quasi-continuous mappings. More 
recently, [231 124] has announced a characterization of the 
precise tail behavior of the (1 + Q:)-norm of the backlog, 
under the MW-a policy. However, in these works, the LDP 
exponent is only given implicitly, as the solution of a compli- 
cated, possibly infinite dimensional optimization problem. 

Our Contributions. 

We establish various qualitative performance bounds for 
a-weighted policies, under the switched network model. In 
the stationary regime, we establish finiteness of the expected 
backlog, and an exponential upper bound on the steady- 
state tail probabilities of the backlog. In the transient regime, 
we establish a maximal inequality on the queue-size pro- 
cess, and the strong state space collapse property under a- 
weighted policies, when a > 1. Our analysis is based on drift 
inequalities on suitable Lyapunov functions. Our methods, 
however, depart from prior work because they rely on dif- 
ferent classes of Lyapunov functions, and also involve some 
new techniques. 

In more detail, we begin by establishing the finiteness of 
the steady-state expected backlog under the MW-a policy, 
for any a £ (0, 1). Instead of the traditional Lyapunov func- 
tion II • ll^ljli, we rely on a Lyapunov function which is a 
suitably smoothed version of || • ||^+i- 

We continue by deriving a drift inequality for a "norm" or 
"norm-like" Lyapunov function, namely, || • ||a+i or a suit- 
ably smoothed version. Using the drift inequality, we es- 
tablish exponential tail bounds for the steady-state backlog 
distribution under the MW-a policy, for any a £ (0, oo). 
Our method builds on certain results from [3] that allow us 
to translate drift inequalities into closed-form tail bounds; 
it yields an explicit bound on the tail exponent, in terms 
of the system load and the total number of queues. This 
is in contrast with the earlier work in [2UI 124] . That work 
provides an exact but implicit characterization of the tail 
exponents, in terms of a complicated optimization problem, 
and provides no immediate insights on the dependence of 
the tail exponents on the system parameters, such as the 
load and the number of queues. Furthermore, in contrast 
to the sophisticated mathematical techniques used in [201 
I24[ . our explicit bounds are obtained through elementary 
methods. For some additional perspective, we also consider 



a special case and compare our upper bound with available 
lower bounds. 

Finally, we provide a transient analysis under MW-a poli- 
cies, for the case where a > 1. We use a Lyapunov drift 
inequality to obtain a bound on the probability that the 
maximal backlog over a given finite time interval exceeds a 
certain threshold. This bound leads to the resolution of the 
strong state space collapse conjecture for the switched net- 
work model when a > 1. This strengthens the multiplicative 
state space collapse results in [17II18| . 

Organization of the Paper. 

The rest of the paper is organized as follows. In Section 
2, we define the notation we will employ, and describe the 
switched network model. In Section 3, we provide formal 
statements of our main results. In Section 4, we establish 
a drift inequality for a suitable Lyapunov function, which 
will be key to the proof of the exponential upper bound on 
tail probabilities. In Section 5, we prove the finiteness of 
steady-state expected backlog when a G (0, 1). We prove 
the exponential upper bound in Section 6. For a special 
instance, we compare this upper bound with available lower 
bounds in the Appendix. The transient analysis is presented 
in Section 7. We start with a general lemma, and specialize 
it to obtain a maximal inequality under the MW-a policy, 
for a > 1. We then apply the latter inequality to prove the 
full state space collapse result for a > 1. We conclude the 
paper with a brief discussion in Section 8. 

2. MODEL AND NOTATION 

2.1 Notation 

We introduce here the notation that will be employed 
throughout the paper. We denote the real vector space of 
dimension M by R^^ and the set of nonnegative Af-tuples 
by R^-'. We write R for R\ and R+ for R^. We let Z be 
the set of integers, Z+ the set of nonnegative integers, and 
N the set of positive integers. 

For any vector x £ R^^, and any a > 0, we define 

iixii. = fEi^-r) • 

For any two vectors x = {xijfL-^ and y = (yi)fLi of the same 
dimension, we let x ■ y = X]i=i 'iot product 

of X and y. For two real numbers x and y, we let a: V 
y = ma.x{x,y}. We also let [x]'^ = xW O.We introduce the 
Kronecker delta symbol 5ij, defined as 5ij = 1 if i = j, and 
5ij — Q ii i ^ j. We let ei = (5ij)j£i be the i-th unit vector 
in R^^, and 1 the vector of all ones. For a set S, we denote 
its cardinality by 15*1, and its indicator function by Is- For 
a matrix A, we let denote its transpose. We will also 
use the abbreviations "RHS/LHS" for "right/left-hand side," 
and "iff" for "if and only if." 

2.2 Switched Network Model 

The Model. 

We adopt the model in [TS] , while restricting to the case of 
single-hop networks, for ease of exposition. However, our re- 
sults naturally extend to multi-hop models, under the "back- 
pressure" variant of the MW-a policy. 



Consider a collection of M queues. Let time be discrete: 
timeslot r £ {0, 1, • • •} runs from time r to r + 1. Let 
Qi{r) denote the (nonnegative integer) length of queue i £ 
{1, 2, . . . , M} at the beginning of timeslot r, and let Q(r) 
be the vector {Qi{T))fii. Let Q(0) be the vector of initial 
queue lengths. 

During each timeslot r, the queue vector Q(r) is offered 
service described by a vector cr(r) = (cri(r))^i drawn from 
a given finite set 5 C {0, 1}*^ of feasible schedules. Each 
queue i £ {1,2,...,M} has a dedicated exogenous arrival 
process (y4i(r))T>o, where Ai(r) denotes the number of pack- 
ets that arrive to queue i up to the beginning of timeslot r, 
and Ai{0) = for aU i. We also let ai{T) = Ai{T+l) - Ai{T), 
which is the number of packets that arrive to queue i dur- 
ing timeslot r. For simplicity, we assume that the ai(-) are 
independent Bernoulli processes with parameter Ai . We call 
A — (Ai)f£i the arrival rate vector. 

Given the service schedule it{t) £ <S chosen at timeslot r, 
the queues evolve according to the relation 

Q,(r + 1)= [Q,(r) -o-,(r)]+ +a,(r). 

In order to avoid trivialities, we assume, throughout the 
paper, the following. 

Assumption 2.1. For every queue i, there exists a cr £ S 
such that (Ji = 1. 



An example: Input Queued (IQ) Switches. 

The switched network model captures important instances 
of communication network scenarios (see [18] for various ex- 
amples). Specifically, it faithfully models the packet-level 
operation of an input-queued (IQ) switch inside an Internet 
router. For an m-port IQ switch, it has m input and m 
output ports. It has a separate queue for each input-output 
pair {i,j), denoted by Qij Q for a- total of M = queues. 
A schedule is required to match each input to exactly one 
output, and each output to exactly one input. Therefore, 
the set of schedules <S is 

m m 

o- = (aij) e {0, l}'"^^'" : ^ atk = ^ CTkj = 1, V i,j 
fc=i fc=i 

We assume that the arrival process at each queue Qij is an 
independent Bernoulli process with mean Xij. 

Capacity Region. 

We define the capacity region A of a switched network as 

i A e Mf : A < ^ a^a, > 0, V o- £ 5, ^ < 1 I . 
I ires creS ) 

It is called the capacity region because there exists a policy 
for which the Markov chain describing the network is pos- 
itive recurrent iff A £ A. We define the load induced by 
A £ A, denoted by p{X), as 



3(A) = inf i ^ : A < ^ < 

1<t6S <tGS 



CtaCT. Oct > 0, V (T £ 5 



Note that p(A) < 1, for aU A £ A. 

^Here we deviate from our convention of indexing queues by 
a single subscript. This will ease exposition in the context 
of IQ switches, without causing confusion. 



The Maxiinwn-Weight-a Policy. 

We now describe the so-called Maximum- Weight-a (MW- 
a) policy. For a > 0, we use Q(t)™ to denote the vector 
(Qf (r))f£i. We define the weight of schedule ct £ 5 to be 
cr ■ Q{t)". The MW-a policy chooses, at each timeslot r, a 
schedule with the largest weight (breaking ties arbitrarily). 
Formally, during timeslot r, the policy chooses a schedule 
(T(r) that satisfies 

fT(r) ■ Qir)" — maxCT ■ Q{t)". 

We define the maximum a- weight of the queue length vector 
Q by Wa{Q) — maxa-es cr ■ ■ When a — 1, the policy is 
simply called the MW policy, and we use the notation w{Q) 
instead of ?i)i(Q). We take note of the fact that under the 
MW-Q policy, the resulting Markov chain is known to be 
positive recurrent, for any A £ A (cf. |15p. 

3. SUMMARY OF RESULTS 

In this section, we summarize our main results for both 
the steady-state and the transient regime. The proofs are 
given in subsequent sections. 

3.1 Stationary regime 

The Markov chain Q(-) that describes a switched network 
operating under the MW-a policy is known to be positive 
recurrent, as long as the system is underloaded, i.e., if A £ A 
or, equivalently, p(A) < 1. It is not hard to verify that 
this Markov chain is irreducible and aperiodic. Therefore, 
there exists a unique stationary distribution, which we will 
denote by tt. We use E„ and P,r to denote expectations and 
probabilities under tt. 

Finiteness of Expected Queue-Size. 

We establish that under the MW-Q policy, the steady- 
state expected queue-size is finite, for any a £ (0, 1). (Recall 
that this result is already known when Q > 1.) 

Theorem 3.1. Consider a switched network operating un- 
der the MW-a policy with oi £ (0, 1), and assume that p(A) < 
1. Then, the steady-state expected queue-size is finite, i.e., 

E,[||Q||i] <«3. 



Exponential Bound on Tail Probabilities. 

For the MW-Q policy, and for any a £ (0,oo), we obtain 
an explicit exponential upper bound on the tail probabilities 
of the queue-size, in steady-state. Our result involves two 
constants defined by 



z? = E[||a(l) 
where p = p(A). 



2M^ 



Theorem 3.2. Consider a switched network operating un- 
der the MW-a policy, and assume that p — p(A) < 1. There 
exist positive constants B and B' such that for all £ £ Z+; 



(a) if a>l, then 



(||Q( 



r)|L+i > B + 2M^l] < 



+ 7 



e+i 



(b) ifaG (0, 1), then 



(||Q(T)||a + l >B' + lOM^l^ < 



5u 



51/ + ^ 



e+i 



Note that Theorem 13.11 could be obtained as a simple 
corollary of Theorem 13.21 On the other hand, our proof 
of Theorem 13.21 requires the finiteness of E,r [||Q||i], and so 
Theorem 13.11 needs to be established first. 

In the Appendix, we comment on the tightness of our 
upper bounds by comparing them with explicit lower bounds 
that follow from the recent large deviations results in [24] . 

3.2 Transient regime 

Here we provide a simple inequality on the maximal ex- 
cursion of the queue-size over a finite time interval, under 
the MW-a policy, with a > 1. 

Theorem 3.3. Consider a switched network operating un- 
der the MW-a policy with a > 1, and assume that p(A) < 1. 
Suppose that Q(0) = 0. Let Qma^ir) = maXig{i,.,.,M} Qi{T), 
and Q*ma.^{T) = max.re{o,i....,T} Qmax(T). Then, for any 
b>0, 



'(Omax(T) > 6) < 



K{a, M)T 
(1 -p)"-i&"+i' 



(1) 



for some positive constant K{a, A4) depending only on a and 
M. 



As an important application, we use Theorem 13.31 to prove 
a full state space collapse result0 for a > 1, in Section [7.31 
The precise statement can be found in Theorem 17.71 



4. MW-a POLICIES : A USEFUL DRIFT IN- 
EQUALITY 

The key to many of our results is a drift inequality that 
holds for every a > and A G A. In this section, we shall 
state and prove this inequality. It will be used in Section [6] 
to prove Theorem l3.2l We remark that similar drift inequal- 
ities, but for a different Lyapunov function, have played an 
important role in establishing positive recurrence (cf. [22j ) 
and multiplicative state space collapse (cf. [18)). 

We will be making extensive use of a second-order mean 
value theorem [2], which we state below for easy reference. 

Proposition 4.1. Let g -. M.'^' -^M. be twice continuously 
differentiable over an open sphere S centered at a vector x. 
Then, for any y such that x -I- y € 5, there exists a S € [0, 1] 
such that 

5(x + y) = g(x) + y^V3(x) + \y'^ + ey)y, (2) 

where V(7(x) is the gradient of g at x, and -ff(x) is the Hes- 
sian of the function g at yi. 

We now define the Lyapunov function that we will employ. 
For a > 1, it will be simply the [a -\- l)-norm ||x||i+a of 
a vector x. However, when a £ (0, 1), this function has 
unbounded second derivatives as we approach the boundary 
of R^'. For this reason, our Lyapunov function will be a 
suitably smoothed version of || ■ ||q+i. 



^ This is strong state space collapse and not full diffusion 
approximation. 



Definition 4.2. Define fa 
when a > 1, and 



to be fair-) 



Uir) 



r", ifr>l, 
(q - l)r^ + (1 - a)r^ -f r, if r < 1, 



when a G (0,1). Let Fa : R+ — >■ R+ be the antiderivative 
of fa, so that Fa{r) = fa{s) ds. The Lyapunov function 
La : R+'^ R-i- is defined to be 



La(x) 



{a + l)Y,Fa{xi 



We will make heavy use of various properties of the func- 
tions fa, Fa, and La, which we summarize in the following 
lemma. The proof is elementary and is omitted. 

Lemma 4.3. Let a G (0, 1). The function fa has the fol- 
lowing properties: 

(i) it is continuously differentiable with fa{0) — 0, /q(1) = 
1, f'aiO) = 1, and fail) = a; 

(ii) it IS increasing and, in particular, fa{r) > for all 
r > 0; 

(ill) we have - 1 < fa{r) <r°' + 1, for all r G [0, 1]; 

(iv) fair) < 2, for all r>0. 

Furthermore, from (Hi), we also have the following property 
of Fa: 

(ill') r°'+^ - 2 < (a + l)Fair) < r"+^ + 2 for all r > 0. 
We are now ready to state the drift inequality. 

Theorem 4.4. Consider a switched network operating un- 
der the MW-a policy, and assume that p = p(A) < 1. Then, 
there exists a constant B > 0, such that if LaiQir)) > B, 
then 

^A/^-. (3) 



E[Lc(Q(r+l))-Lc(Q(r)) | Q(r)] < 



The proof of this drift inequality is quite tedious when a ^ 1. 
To make the proof more accessible and to provide intuition, 
we first present the somewhat simpler proof for a = 1. We 
then provide the proof for the case of general a, by consid- 
ering separately the two cases where a > 1 and a G (0, 1). 

We wish to draw attention here to the main difference 
from related drift inequalities in the literature. The usual 
proof of stability involves the Lyapunov function ||Q||^l{]J; 
for instance, for the standard MW policy, it involves a quadratic 
Lyapunov function. In contrast, we use ||Q||a+i (or its 
smoothed version), which scales linearly along radial direc- 
tions. In this sense, our approach is similar in spirit to [3], 
which employed piecewise linear Lyapunov functions to de- 
rive drift inequalities and then moment and tail bounds. 

4.1 Proof of Theorem l44l: a = l 

In this section, we assume that a = 1. As remarked ear- 
lier, we have Lai'x) = ||x||2. 

Suppose that ||Q(t)||2 > 0. We claim that on every sam- 
ple path, we have 



|Q(r + l)||2-||Q(r)||2< 



Qir)-Sir) + \\SiT) 
IIQMII2 



(4) 



where S{t) = Q(r + 1) — Q(t). To see this, we proceed as 
follows. We have 



IIQWII2 + 
2 



Ciir)-S{T)+\\S{r)\\P' 



IIQMII2 

> \\Q{r)\\l + 2{Q{r)-d{r) + \\S{r)\\l) 

> \\QiT)\\l + 2Qir)-S{T) + \\S{r)\\l 
= |lQ(r) + ^(r)||^ = ||Q(r + l)||i 



(5) 



Note that 



\\Q{r)\\l + Q{r)-S{r) + \\S{r)\\l 



Qir) 



S{r) 



+ ^II^MIl2>0. 



We divide by ||Q(r)||2, to obtain 

, Q{T)-S{r)+\\Sir)\\l ^ 

Therefore, we can take square roots of both sides of ([5]), 
without reversing the direction of the inequality, and the 
claimed inequality @ follows. 

Recall that |(5i(T)| < 1, because of the Bernoulli arrival 
assumption. It follows that ||d(r)||2 < M^^^. We now take 
the conditional expectation of both sides of Q . We have 



E 

< E 



[||Q(^ + 1)I|2-|1QWI|2 I Q(r)] 
Q(r) • a(r) - Q(r) ■ o-(r) + J\/ 



IIQMIh 



E"i Q^{r)E [a.(r)] ~ Q(r) ■ ajr) + M 

IIQWII2 
Ef£iQ4^)A.-w(Q(r)) + M 

IIQMII2 
M - {1 - p)w{Q{t)) 
IIQWII2 



(6) 



The last inequality above is justified as follows. From the 
definition of p = p(-^), there exist constants a^- > such 
that E<Tes '^'^ — P' ^^'^ 



Therefore, 

Q^{t)\ = Q(r) ■ A < ^ a„Q(r) • a 

< ^ a^i«(Q(r)) < p™(Q(r)). 

Let Qmax(-r) = maxfii Qiir). Then, 

IIQMII2 < (MQL.W)^ = A-nQ^^^r). 
From Assumption 12. II we have 

w{Q{t)) > On.ax(r). 

Therefore, the RHS of ([6} can be upper bounded by 
M 



(7) 



(8) 



IIQWII2 

when ||Q('r)[|2 is sufficiently large. 



< -i(l-p)M-l/^ 



4.2 Proof of Theorem |44l a > 1 

We wish to obtain an inequality similar to ([6]) for La(Q(-)) = 
|Q(-)|ji+Q under the MW-q policy, and we accomplish this 
using the second-order mean value theorem (cf. Proposition 
14. ip . Throughout this proof, we will drop the subscript a + l 
and use the notation || ■ || instead of || ■ ||q+i. 
Consider the norm function 



5(x) = llxll 
The first derivative is 



VsW = ||x|| °'{xi,...,Xm) = 



Let H{x) = [Hij{x)]f'j^i be the second derivative (Hessian) 



matrix of g. Then, 



dxida 



■(x) 



X 



|2a+l ■ 



where Sij is the Kronecker delta. By Proposition 14.11 for 
any x, y G , and with (5 = y — x, there exists a, 6 G [0, 1] 
for which 

g{y) = 3(x) + 5"^ Vp(x) + i<5^//(x + 66)8 
= ff(x) + ||x|r" (^E-^'^") 

- |||x + 98\\-'-^'^ (^{x, + es^Tix, + es^rs^s^i 

= 5(x) + iixir" (e-^'^") 
+ |iix+e^ir" (Y.{x,+e5,r-'5i^ 



Using X = Q(r), y = Q(r + 1) and 8{t) = Q(r + 1)-Q(r), 
we have 



IIQ(^ + i)ll = IIQ(^ 



+ 



IIQMIh 

i:M^^r) + e5,{r)r-H^{T) 



||Q(r)+e<5(r)r 



||Q(r) + e<5(r)||i+2" 

Therefore, using the fact that 5i(r) G { — 1, 0, 1}, we have 
||Q(r + l)||-||Q(r)|| 



(9) 



< 



i:.Hr)Qnr) 



IIQMIh 



+ 



mr) + e8{T) 



(10) 



We take conditional expectations of both sides, given Q(t). 
To bound the first term on the RHS, we use the definition 
of the MW-a policy, the bound (O on A, and the argument 
used to establish ([8} in the proof of Theorem 14.41 for a = 1 



(with K;(Q(r)) replaced by iiia(Q(T))). We obtain 



E 



Q(^) 



Note that 



and 



(12) 



Therefore, 



E 



Mr) 



Qir) 



< -(1 -p)M"T+^. (13) 



Consider now the second term of the conditional expec- 
tation of the RHS of Inequality (|10[) . Since q > 1, and 
Si{T) £ { — 1,0,1}, the numerator of the expression inside 
the bracket satisfies 

^(Q«(r) + e5,(r))"-^ < M(Q,nax(r) + l)"-\ 

i 

and the denominator satisfies 

\\Q{T)+ed{r)r > ([Qmax(r)-1] + )", 

where we use the notation [c]+ = V c. Thus, 

"E,(Q.M + / Q A/(Q^,, + 1)— 1 



\\Q{r) + eS{7 



< 



2 ([Qn.ax(T) - 1] + )° 



Now if ||Q(t)|| is large enough, (5max(T) is large enough, and 
^ • caji be made arbitrarily small. Thus, the 

conditional expectation of the second term on the RHS of 
P0|) can be made arbitrarily small for large enough ||Q(r)||. 
This fact, together with Inequality (|13p . implies that there 
exists B > such that if ||Q(r)|| > B, then 



E 



[lIQC 



r + l) 



IQMII QM < 



1 



4.3 Proof of Theorem 1331 a G (0 , 1 ) 

The proof in this section is similar to that for the case 
a > 1. We invoke Proposition 14.11 to write the drift term 
as a sum of terms, which we bound separately. Note that 
to use Proposition 14. II we need La to be twice continuously 
differentiable. Indeed, by Lemma 14.31 (i). fa is continuously 
differentiable, so its antiderivative Fa is twice continuously 
differentiable, and so is La- Thus, by the second order mean 
value theorem, we obtain an equation similar to Equation 

ia(Q(r+l))-L„(Q(r)) 



j:iSi{r)faiQ.{r)) 



ig(QW) 



+ 



Lg(Q(r) + M(r)) 



LI"'+\CI{t) + eS{r)) 
Again, using the fact 5i(r) G { — 1,0, 1}, 

La{Q(r + 1)) - Lc(Q(r)) < Ti + Ta, 

where 



(14) 



and 



L^{Q{T) + eS{r)) 



Let us consider T2 first. For a £ (0, 1), by Lemma |4.3 
(iv), fLir) < 2 for aU r > 0. Thus 



T2 < 



2M 



L^{Q{r) + 9S{r)) 



M 



ig(Q(r) + M(r))- 



which becomes arbitrarily small when Lc«(Q(t)) is large 
enough. 

We now consider Ti. Since fa{r) < + 1 for all r > 
(cf. Lemma [43] (iii)), and (5i(r) G {-1,0, 1}, 



Ti < 



M 



Lg(Q(r)) ^Lg(Q(T))- 



When we take the conditional expectation, an argument sim- 
ilar to the one for the case a > 1 yields 



E 



Q(t 



^ ^ «'a(Q(-r)) 



Again, as before, Wci(Q(t)) > Qmax(''")- For the denomi- 
nator, by Lemma 14.31 (iii'), for any r > 0, we have (a + 
i)Fa{r) < r°'+^ + 2. Thus 



LaiQir)) < 



^(Q,(r) + 2)"+i 



< (Af(Q,„ax(r) + 2)"+i)" 
= M^(Q^ax(r) + 2). 



Therefore, 

"E.<5.WQ?(r) 



igQ(T) 



Qir) 



< -(l-p)M~~- 



Qmax('^) 



(Q max 

If (5max(T) is large enough, we can further upper bound the 
RHS by, say, -|(1 -p)M-^. 

Putting everything together, we have 



E 



[LaiQir + l))-La{Q(T)) I Q(r)] 



3 a M 

<--(l-p)M-TT. + _^+E[r.|Q(.)], (16) 

if Qmax(T) is large enough. As before, if I/q,(Q(t)) is large 
enough, then Qmax(T) is large enough, and T2 and ^c. ("Q(r)) 
can be made arbitrarily small. Thus, there exists B > 
such that if Lct(Q(r)) > B, then 



E [LaiQir + 1))- LaiQir)) | Q(r)J < --(1 - p)Af^ — . 

5. PROOF OF THEOREM 

In this section, we fix some a £ (0, 1) and prove that 
the MW-Q policy induces finite steady-state expected queue 
lengths. The key to our proof is the use of the Lyapunov 
function $(x) = L^(x). This is to be contrasted with the 
use of the standard Lyapunov function, xl+'^, in the lit- 
erature, or the "norm"-Lyapunov function Z/c,(x) that we 
used in establishing the drift inequality of Theorem 14.41 

Throughout the proof, we drop the subscript a from La, 
Fa, and fa, as they are clear from the context. We also 
use |jx|| to denote the (a -I- l)-norm of the vector x, again 
dropping the subscript. 



As usual, we consider the conditional expected drift at 
time r, 

D{Q{r)) = E [<E.(Q(r + 1)) - $(Q(r)) | Q(r)] . 

Recall the notation (3max(T) — max{Qi (r), . . . , Qj\/(r)}. 
Since for Qmax < 2, _D(Q(r)) is bounded by a constant, 
we assume throughout the proof that Qmax(T) > 2. As in 
the proof of Theorem l4.4l for the case a G (0, 1), we shall use 
the second order mean value theorem to obtain a bound on 
D(Q(r)). Using the definition $(x) = -L^(x), we have 



[V<E.(x)]^ = 2L(x) 



dLjx.) 

dxi 



2f{x,)L'-^^), (17) 



and 

dxidxj 



(x) = 2^.^+2L(x^^'^W 



dxi dxj 



J{Xi)f{Xj) 



dxidxj 
fix,) af{x,)f{x,) 



L«(X) L2a + l(x) 



= 2(1 - ")^^^5^ + 2<5.,/'(xOi'-"(x). 

(18) 

Using the second order mean value theorem and the notation 
Q(r + 1) = Q(r) + S{t), we have, for some 6 G [0, 1], 



^-CQCr + l)) -$(Q(r)) 
<2L^-"(Q(r)) (^E/(Q.(r))5.(^; 

+ L^-"(Q(r) + e5(r)) /'(0,(r) + e5,(r)) 



+ (l-a 



(19) 



Let us denote the three terms on the RHS of (|19[) as Ti, T2 
and T3 respectively, so that 

Ti = 2L^-'^(Q(r)) (j2f{Q.{r))S,ir)^ , 

= Li-"(Q(r) + 9S(r)) f'{Q,{r) + M,(r))j , 



and Ts = (1 - a; 



L^°'{Q{T) + 9d{T)) 
We consider these terms one at a time. 

a) By Lemma 113] (ui), /(r) < r" + 1. Using the fact that 
Si{T) £ { — 1,0, 1}, we obtain 

fi <2L^-"(Q(r)) (^M + J2QnrMr)^ ■ 

When we take a conditional expectation, an argument sim- 
ilar to the one in earlier sections yields 



J2Qnr)S.{r) I Q(r) 



Thus, 

E[Ti|Q(r)] < -2{1- p)w4Q{T))L'-"{Q{r)) 
+2ML'-"{Q{r)). 
In general, for r, s > and /3 G [0, 1], 

{r + sf < / + (20) 
Now, by Lemma|43](iii'), r"+^-2 < {a + l)F{r) < r°+^ + 2, 



J2 - 2A/ < (a + 1) ^ F{x,) <J2^1 



2M. 



We use inequality with r = s = 2M, and /3 

(1 - a)/(l + a) G (0, 1), to obtain 



L^-"(x) = (a + l)^F(x.; 



a+l 



2M+;^x° 



(2M)^ + f^^cr' 



= (2M)TT^ + ||x||'"". 

A similar argument, based on inequality (|20|) . with r — {a + 
l)F{xi) and s = 2M, yields 

||x||'-" - (2M)TTf < Li'°(x). 

We also know that 

^4Q{r)) > Q'LUr) > M-*||Q(r)|r. 
Putting all these facts together, we obtain 

E [fi I Q(r)] 

< -2(1 - p)w^{Q{T))L'-"{Q{r)) + 2M L'-" (Qir)) 

< -2(1 - p)M-^ ||Q(r)|r (llQ(r)ir'^ - (2M)^) 
+ 2Af((2M)TTf + ||Q(r)||^"") 

= -2(1 -p)Af-^||Q(r)|| +2A/||Q(r)||^-'^ 
+ 2Tfe (1 - p)M^ llQ(r) ir + (2Af)TT^ . (21) 



b) We now consider the term T2. Since a G (0,1), we 
have f'{r) < 2 for all r > 0. Since we also have 6 G [0, 1] 
and Si{T) G {—1,0, 1}, and using the fact that L^~°'{x) < 

{2M)T^ + ||x||^-°, we have 

fa < 2AfL(Q(r) +e<5(r))i-" 

< 2Af ((2M)TTf + ||Q(r) + 6l5(r)||i-") 

= (2Af)TT^ + 2Af||Q(r) + M(r)||^-°. 

Now IIQ(r) +eS{r)\\ < ||Q(r) + 1|1 < ||Q(r)|| + ||1|| = 
||Q(r)|| + Af^. Since a G (0,1), we have < 1 - a < 1, 



and so 

\\Q(r) + eS(T)\\'-'^ < (||Q(r)||+M^ 

< \\Q{r)f-^ + M^. 
Putting everything together, we have 

T2 < {2M)Th +2M(\\Q{r)f-°' + M^'J 

= (2 + 2TT^)qMTT^ +2M||Q(r)||'"". (22) 



c) We finally consider T3. For notational convenience, we 
write X — Q(r) + 9S{t), and let a-max = max{a;i, . . . ,xm}- 
Note that since 5i{T) £ {—1, 0, 1}, 9 £ [0, 1], and we assumed 
that Qmax > 2, we always have Smax > 1- We consider the 
numerator and the denominator separately. First use the 
facts that /(r) > for all r > (cf. Lemma 14.31 (ii)). and 
Siir) e {-1,0,1}, to obtain 

Since / is increasing in r (cf. Lemma 14.31 fiil'l. 

f{^.)^ < (M/(:r^ax))' = MV'(2 



Thus, 



Next, since F{r) — f{s) ds and / > 0, we have F > as 
well. Thus, 



L^"(x) = ( (a + 1) E F{x.) ] >{{a+ l)F(x^ax))^ , 
and so 



AfV'(a;max) 



n<{l-a)- 

((Q + l)F(a;n,ax))~ 

We will show that T3 is bounded above by a positive con- 
stant, whenever Xmax > 1- Indeed, by Lemma [4.31 fiiil and 
(iii'), as a;max 00, 



(l_a) ^^'/'(^max) ^ ^ {l-a)M^ 

((a+ l)F(2;max))~ 

as Xmax — > 00. Using the continuity of / and F for Xmax > 
1, it follows that there exists a constant K > such that 



T3 < (1-q)- 



MV'(a;max) 



((a+ l)i^(a;max))^ 



< K, (23) 



Putting together the bounds and ^ for Ti, 

and T3, respectively, we conclude that, for Xmux > 1, 

^5(Q(r)) <-2(l-p)M-^||Q(r)||+2M||Q(r)||^-" 

+ 4(1 -p)MT^||Q(r)|r + (2Af)Tfc 

+ (2 + 2Tfe)Q,AfTfe +2A/||Q(r)||^"" + ^ 

= -^||Q(r)|| + Ci||Q(r)|l^-" + C2||Q(r)|r + K, 

(24) 

for some positive constants A, Ci, C2 and K. Since a € 
(0, 1), the ||Q(t")|| term dominates. In particular, there exist 
positive constants A and D such that as long as max; Qi{T) > 
D, we have 



D{Q{t)) < -^||Q(r)||+J^. 



(25) 



On the other hand, on the bounded set where maxi Qiij) < 
D, the drift D(Q(r)) is also bounded by a constant. By 
suitably redefining the constant K, we conclude that Eq. 
(|25|l holds for all possible values of Q(t). 

The drift condition (|25p is the standard Foster-Lyapunov 
criterion for the Lyapunov function $ and implies the pos- 
itive recurrence of the Markov chain Q( ) under the MW-a 
policy, for a G (0,1). The irreducibility and aperiodicity 
of the underlying Markov chain implies the existence of a 
unique stationary distribution tt as well as ergodicity. Let 
Qoo be a random variable distributed according to tt. Then 
Q(r) converges to Qoo in distribution. Using Skorohod's 
representation theorem, we can embed the random vectors 
Q(t) in a suitable probability space so that they converge to 
Qcxi almost surely. With this embedding, ||Q(t)|| ||Qoo||, 
and IIQ(^)ll)/r IIQooll, almost surely. Using Fa- 

tou's Lemma, we have 



E[||Qo 



= E 



luninflEllQW 

r=0 

1 

y E IIQW 



< liminfE 

T 



On the other hand, the drift inequality (|25p is well known 
to imply that the RHS above is finite; see, e.g.. Lemma 4.1 
of [?]• This proves that E[||Qoo||] < 00. By the equivalence 
of norms, the result for ||Q||i follows as well. 

6. EXPONENTIAL BOUND UNDER MW-a 

In this section we derive an exponential upper bound on 
the tail probability of the stationary queue-size distribution, 
under the MW-q policy. 

6.1 Proof of Theorem IS^It a > 1 



whenever Xmax > 1- 



The proof of Theorem |3]2] relies on the following proposi- 
tion, and the drift inequality established in Theorem 14.41 

Proposition 6.1. Consider a switched network operating 
under the MW-a policy with a > 1, and arrival rate vector 
X with p — p{X) < 1. Let tt be the Let unique stationary 
distribution of the Markov chain Q(-). Suppose that for all 



||Q(r + l)|l<.+i-||Q(r)|l<.+i <Un 



Furthermore, suppose that for some constants B > and 
7 > 0, and whenever ||Q(r)||i4.a > B, we have 



E[|IQ(r + l)|U+i-||Q(r) 
Then for any £ £ Z+ , 



ri\Q{r)] < -1- 



||Q(r)||a+i > B + 2v,,,^^l) < [--^) 



e+i 



Proposition l6.1l follows immediately from the following Lemma, 
which is a minor adaptation of Lemma 1 of [3] . An interested 
reader may refer to the proof of Theorem 1(a) in [3] to see 
how Lemma |6 . 2 1 leads to the bound claimed in Proposition 

Lemma 6.2. Under the same assumptions in Proposition 



with the maximal lemma to obtain a maximal inequality for 
the switched network. We then apply the maximal inequal- 
ity to prove full state space collapse for a > 1. 

7.1 The Key Lemma 

Our analysis relies on the following lemma: 

Lemma 7.1. Let {^n)nez+ be a filtration on a probability 
space. Let {Xn)nez^ be a nonnegative ^n- adapted stochastic 
process that satisfies 



]<X„ + B 

n 



(27) 



where Bn 's are nonnegative random variables ( not necessar- 
ily .^n-adapted) with finite means. Let X* = max{Xo, . . . ,X„} 
and suppose that Xo = 0. Then, for any a > and any 
T e Z+, 



6.1[ and for any c > B 
P^(||Q(r)|U+i 



< 



> C + Vu 



(IIQMII 



P(Xt > a) < 



(26) 



Proof. Since this Lemma is a minor adaptation of Lemma 
1 in [3] , we only indicate the changes to the proof of Lemma 
1 in [3] that lead to our claimed result. First let us point 
out that the proof in [3] makes use of the finiteness of the 
expected value of the Lyapunov function under the station- 
ary distribution tt. In our case, the Lyapunov function in 
question is || ■ and the finiteness follows from Theorem 

I3.1l bv noticing that all norms are equivalent. 

As in the proof of Lemma 1 in [3], define $(x) = max{c, ||x||a-t 
Note that the maximal change in $(x) in one time step 
is at most z^max- As in [3], we consider all x satisfying 
< < c-l-fmax. Then, 

E[|.(Q(r + l))|Q(r) = x] - 4.(x) 

< Y. P(x,x')(||x'||-||x||) 

x':||x'||>||x|| 

<E[||a(r)||] = V. 

The proof of Lemma 1 in esentially used z^max as an upper 
bound on v. For our result, we keep v and then proceed as 
in the proof in [3]. □ 



Completing the Proof ofTheorem \3.2\ (ct >!). 

Now the proof of Theorem 13.21 follows immediately from 

Proposition 16.11 by noticing that Theorem 14.41 provides the 

desired drift inequality, and the maximal change in ||Q(r)||i+c, 

1 

in one time step is at most t'max = M 1+° , because each 
queue can receive at most one arrival and have at most one 
departure per time step. 

6.2 Proof of Theorem O a e (0 , 1 ) 

The proof for the case a G (0, 1) is entirely parallel to that 
in the previous section and we do not reproduce it here. 

7. TRANSIENT ANALYSIS 

In this section, we present a transient analysis of the MW- 
a policy with a > 1. First we present a general maximal 
lemma, which is then specialized to the switched network. In 
particular, we prove a drift inequality for the Lyapunov func- 
tion -£/(x) = ^jq-j- a;"^^. We combine the drift inequality 



This lemma is a simple consequence of the following stan- 
dard maximal inequality for nonnegative supermartingales 
(see for example, Exercise 4, Section 12.4, of [9]): 

Theorem 7.2. Let (^n)nez^. be a filtration on a prob- 
ability space. Let {Y„)nez^ be a nonnegative ^n-o,dapted 
supermartingale, i.e., for all n, 

E[y„+i I < y„. 

Let Yt = max{yo, . . . , Ft}. Then, 

E[yo] 



p(y^ > a) < 



Proof of Lemma 17.11 First note that if we take the con- 
ditional expectation on both sides of (|27|l , given ^„ , we have 

E[X„+i I < E[X„ I + E[B„ I F„] 

= X„+E[B^\F^]. 

Fix T G Z+. For any n<T, define 

"T-l 



Yn — Xn -\- 1 



Then 

E[y„+i I 



E[X„+i I 

T-l 

E ' 



-l-E 



.fc=n+l 

T-l 

< X„ 4-E[Bn I K,] +E ' 



Bk ] .J^n 



Y^. 



Thus, Yn is an .^„-adapted supermartingale; furthermore, 
by definition, Yn is non-negative for all n. Therefore, by 
Theorem El 



p(y; > a) < 



E[y,] 



E 



a a 

But Yn > Xn for all n, since the Bk are nonnegative. Thus 



E 



¥{Xt >a)< F{Yt >a)< 



□ 



We have the following corollary of Lemma 17.11 in which we 
take all the B„ equal to the same constant: 

Corollary 7.3. Let and X* be as m Lemma 

\7. 1\ Suppose that 



E[Xr^ + l \ .^„] <X„+B, 

for all n > 0, where B is a nonnegative constant. Then, for 
any o > and any T £ Z+, 

¥{Xt >a)< 

7.2 The Maximal Inequality for Switched Net- 
works 

We employ the Lyapunov function 



(28) 



to study the MW-a policy. This is the Lyapunov function 
that was used in [15] to establish positive recurrence of the 
chain Q(-) under the MW-a policy. Below we fine-tune the 
proof in [15] to obtain a more precise bound. 

Lemma 7.4. Let a > 1. For a switched network model 
operating under the MW-a policy with p — p(X) < 1, we 
have: 



E[L(Q(r+l))-L(Q(r)) | Q(r)] < 



K{a, M) 



(29) 



where K{a,M) is a constant depending only on a and M. 

Proof. We employ the same strategy as in previous sec- 
tions. By the second-order mean value theorem, there exists 
9 e [0, 1] such that 

L(Q(r-f l))-L(Q(r)) 

1 " 

i — l 

M M 

= ^Qr(r)5,(^) +E + OHr)r~'SUr). 

1=1 1=1 

Let us bound the second term on the RHS. We have 

M 

J2a{Q.iT)+e5.{r)r-'5Ur) 

i = l 

M M 

i = l 1 = 1 

i\/ M 

< a^(2"-^Qr-H^) + 1) = ^2'^'' E W + 

i=l 1=1 

<a2"'^MQ'^l^{r) + aM. 

The third inequality follows because when Qi (r) > 1, {Qi{T) + 
l)"-i < (2g,(r))'^-i = 2'^-iQr'M, and when Qi{r) = 0, 



1. 



Let us now take conditional expectations. From Section [4] 
we know that 



E 



< -{1 - p)w^{Q{t)) 

< -(1 - p)Qmax(T). 



Thus, if we combine the inequalities above, we have 
E[L(Q(r+l))-L(Q(r))|Q(r)] 

< -(1 - p)Qmax(r) + a2"-'MQZ,-Ur) + aM. (30) 



It is a simple exercise in calculus to see that the RHS of pO[l 
is maximized at Qmax(T) = (a — 1)2"~^M/(1 — p), giving 
the maximum value 



(q ^ i)"-i2"("-i)M" 



+ aM = 0((l-p)i-"). 



□ 



Proof of Theorem \3.3\ 

Let fe > 0. Then 



a+1 



< P max L(Q(r)) > b°" 

- \Te{o....,T} - a + 1 

Now, by Lemma [7.41 and CoroUarv 17.31 

max L(Q(t > b < \ \ fr— 

■e{o,....T} ^^^"-a + 1 J- (l-p)"-ib«+i 



K{a, M)T 
(1 -p) — 



where K{a, M) = (a -f l)K{a, M). 



7.3 Full State Space Collapse for a > 1 

Throughout this section, we assume that we are given 
a > 1, and correspondingly, the Lyapunov function L{x) = 
TdpT 5]]i=i To state the full state space collapse result 

for a > 1, we need some preliminary definitions and the 
statement of the multiplicative state space collapse result. 

Let E be the convex hull of S (the set of feasible schedules), 
and let A be defined by 

A = I A G M.Y ■ \ < cr' componentwise, for some cr' £ e|. 

Note that this is the closure of the capacity region A defined 
earlier. Recall the definition of the load p(A) of an arrival 
rate vector A. It is clear that A G A iff p(A) < 1. Define 9A 
the set of critical arrival rate vectors: 



A- A = |a e A : p(A) = l|. 



Now consider the linear optimization problem, named DUAL(A) 
in [H]: 

maximize ^ ■ A 
subject to maxcrgs ^ • < 1, 
i £ . 

For A G 9A, the optimal value of the objective in DUAL(A) 
is 1 (cf.[T8]). The set of optimal solutions to DUAL(A) is a 
bounded polyhedron, and we let <S* = <S*(A) be the set of 
its extreme points. 

Fix A G 9A. We then consider the optimization problem 
ALGD(w): 

minimize L{x) 

subject to ■ X > for all ^ G 5* (A), 
X G K+ . 



We know from [18] that ALGD(w) has a unique solution. 
We now define the lifting map: 

Definition 7.5. Fix some X e 9A. The hfting map A"^ : 

jjhs _^ jjjM j^Q^pg ^ iq j/jg iijiiqug solution to ALGD(w). 

We also define the workload map : R^' Rf *'^^' by 

w^^(q) = (^q)se5nA)■ 

Fix A £ dA. Consider a sequence of switched networks 
indexed by r € N, operating under the MW-a pohcy (recall 
that Q > 1 here), all with the same number M of queues and 
feasible schedules. Suppose that A"" £ A for all r, and that 
A'' — A — r/r, for some T € R^^. For simplicity, suppose 
that all networks start with empty queues. Consider the 
following central limit scaling. 



(31) 



where Q'"(t) is the queue size vector of the rth network at 
time r, and where we extend the domain of Q'^(-) to R+ by 
linear interpolation in each interval (r — 1, r). 

We are finally ready to state the multiplicative state space 
collapse result (Theorem 8.2 in [18]): 

Theorem 7.6. Fix T > 0, and let 

||x(-)||= sup \x,{t)\. 

ie{l,...,M},0<t<T 

Under the above assumptions, for any £ > 0, 
||q'-(-)-A^(W^^q'-(.)))|| 



lim I 

r— >oo 



< £ 



l|q'-(-)llvi 

We now state and prove the full state space collapse result. 



Theorem 7.7. Under the same assumptions in Theorem 
\7.6[ and for any e > 0, 

lim P (||q'-(.) - A^(VK^q'-(.)))|| < e) = 1. 

Proof. First note that since A*" = A — F/r, the cor- 
responding loads satisfy Pr < 1 — C/r, for some positive 
constant C > 0. By Theorem 13.31 for any 6 > 0, 



, . ,\ K(a,M)r^T 

K{a, M)r^+°'T 

Then with a = h/r and under the scaling in pip . 

K{a,M) T 



l|q''(-)ll >a) < 



for any a > 0. 



For notational convenience, we write 

i3(r) = ||q'-(.)-A^(VK^(q7.)))ll 



Then, for any a > 1, 



D{r) e II -r/ Ml ^ 
^ ' > - or ||q (Oil > a 



Note that by Theorem 17.61 the first term on the RHS goes 
to as r — ^ oo, for any a > 0. The second term on the 
RHS can be made arbitrarily small by taking a sufficiently 
large. Thus, P(D(r) > e) — > as r — i- oo. This concludes 
the proof. □ 

8. DISCUSSION 

The results in this paper can be viewed from two differ- 
ent perspectives. On the one hand, they provide much new 
information on the qualitative behavior (e.g., finiteness of 
expected backlog, bounds on steady-state tail probabilities 
and finite-horizon maximum excursion probabilities, etc.) of 
MW-a policies for switched network models. On the other 
hand, at a technical level, our results highlight the impor- 
tance of choosing a suitable Lyapunov function: even if a 
network is shown to be stable by using a particular Lya- 
punov function, different choices may lead to more powerful 
bounds. 

The methods and results in this paper extend in two di- 
rections. First, all of the results, suitably restated, remain 
valid for multihop networks under backpressure-Q policies. 
Second, the same is true for flow-level models of the type 
considered in [11] . These extensions will be reported else- 
where. 
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APPENDIX 

A. TIGHTNESS OF THE UPPER BOUND 

Here we compare the exponential upper bound in Theo- 
rem 13.21 with a lower bound that we shall obtain from the 
LDP results in [24]. To be able to evaluate a useful lower 
bound explicitly, we consider the case of an input-queued 
(IQ) switch. As discussed in Section 12.21 in an m-port IQ 
switch, there are M = queues. Let A — (Xij) be the 
vector of arrival rates. Then, the load p — p{X) is 



p = max 



^max 



Upper bound for IQ switch. 

First, we specialize Theorem 13.21 to the case of an IQ 
switch. 

Proposition A.l. Consider an m-port IQ switch oper- 
ating under the MW-a policy, with arrival vector X so that 
p = p(A) < 1. Let TT be the stationary distribution of the 
queue-size. Then, for some large enough constants B > 
and B' > 0, and for every £ G Z+ : 

(i) if a > 1, then 

(llQI|c+i > B-f 2m^£) < 



1 + 



i-p 



(ii) and if a £ (0, 1), then 

f||Q||<.+i > B' + lOm*^) < 



1 + 



Before providing the proof, we note that Proposition lA.ll 
suggests that for all a > 0, as p — >■ 1, and using log(l/(l + 
r)) « — r for small r > 0, we have 

limsupilogP„(||Q(r)|| >i?) < -i-f m-^"^. (32) 

R^oo ti iUU 



Proof of Proposition lA.ll We need to identify the max- 
imal change I'max, the drift constant 7, and v. Since M = 



||Q(r + l) -Q(r)||i+<, < mTT^ 
2 

For a > 1, m"+i can serve as i^max for ||Q(-)||c,+i. For 

2 

01 e (0, 1), 5m"+i can serve as Vraax for La(Q(-))- The drift 
constant 7 = ^ — is obtained in Lemma rA.2l stated be- 
low. Finally, for u, we have u = ¥. [||a(l)||i+a] < (pm) 1+° < 
mT+^. Thus, 

7 > 1 - P 
V ~ 2m 

Putting everything together and applying Theorem 13.21 we 
obtain for a > 1 and some B > 0, 



\Q\\^+i > B + 2m — ej < 
and for a £ (0, 1) and some B' > 0, 

(llQI|c+i > B' + lOm^^) < 



1 



1 + 



e+1 



1 + 



This completes the proof of Proposition lA.ll □ 



where 



Lemma A. 2. Under the same assumptions of Proposition 
\A.1[ and for all a > 0, there exists a constant B > such 
that 



(33) 



2m'»/(i+") 



E[Lc(Q(r + l))-ic«(Q(r)) | Q(r)] < 

whenever LaiQir)) > B. 

Proof. For an IQ switch, and with a sUght abuse of nota- 
tion, we write Q = [Qij]- Recall that a schedule can serve m 
queues simultaneously subject to the matching constraints. 
Because of this structural property, we claim that for any 

Q = lQ^J] € zil^x'". 



< mwa{Q)~ 



Equivalently, 



"'c(Q(r))/|iQ(r) 



(34) 



(35) 



By inspecting the proof of Theorem l4.4l for general switched 
networks, we realize that the desired bound (|33|l follows from 
P5|l . Therefore, to establish Lemma lA.21 it is sufficient to 
verify p4)l . 

Suppose that cr^ — [o'^j] is a schedule with maximum a- 
weight for a given Q. With some abuse of notation, let us 
denote a°(i) = j if = 1. Then, ™,(Q) = Ei'li Q7aO(^)- 
It can be shown that there exist m — 1 other schedules (or 
matchings) cr^ , . . . ,(t™~^ so that all queues are served 
by the m schedules cr" , cr^ , . . . , cr'"^^. Since WaiQ) is the 
maximum a-weight, it follows that for any k{0 < k < m— 1), 



(36) 



where the last inequality follows from the standard norm 
inequality ||x||a > ||x||i+a. Raising to the power (1 + a)/a 
on both sides of (|36p . then summing over all k, and using the 
property that the schedules cr'' cover all of the queues, 
we obtain 



mWa(Q)" 



(37) 



This completes the verification of 1)34^ and the proof of 
Lemma IX2I □ 



Hi\\\\)= E A.,log(^) + (1-A, 



I log 



1-A, 



Furthermore, r(A) is the solution to the optimization prob- 
lem: 



mmimize 
subject to 



X > A cr' 



for some cr' G E, 



where E is the convex hull of the set of feasible schedules 
S. Clearly, an explicit formula for 6a in terms of p(A) and 
the switch size m seems impossible, evenwhen A is uniform, 
i.e., A = [p/m]. However, as we show next, it is possible to 
obtain a useful lower bound. 

In order to obtain a lower bound on the large deviation 
probability, or equivalently, an upper bound on Oa , it is suf- 
ficient to restrict to symmetric overload arrival rates A in 
the optimization problem (|38|) . Thus, let us assume that 
Aij = (1 + e)/rn for all i,j, where e > 0. Then, it can be 
checked that 



r(A) 



l + e~l 



Therefore, the optimization in 



1+e, l+£ 
log 



: £771 1 + 



reduces to minimizing 

1 _ l+£- 



+ (1 



1 + e 



)log 



1- 



(39) 

over all e > 0. Again, a closed form solution seems im- 
possible, but we can look for an approximation. We are 
interested in comparing the bounds for large m and p near 
1, and we will develop a good approximation in that regime. 
We expect the optimizing value of e in (|39p to be small. 
Therefore, we shall use the Taylor series expansion for log 
up to the first two terms, i.e. log(l + x) ~ x — x'^/2. With 
these approximations, minimizing (|39l) boils down to solv- 
ing a quadratic equation. This leads to an optimal solution 
e* ~ 1 — p. Indeed, if p is near 1, e* is quite small, thus 
justifying our approximations. Using e* ~ 1 — p, we obtain 

Oa < 2m'"/''+")(l -p). (40) 
That is, for p near 1 and for m large enough, we have 

lim inf ^log¥^{\\Q{T)\\a+i> R) 

>-2m^°'/'-''+"\l-p). (41) 



Lower Bound for IQ Switch. 

We now derive an exponential lower bound using the re- 
sults of [24] and assuming uniform arrival rates, i.e., A — 
[p/m] with p < 1. In [24], the authors establish an LDP 
for the switched network model. They show that under the 
MW-a policy, with arrival rates A satisfying p(A) < 1, there 
exists 9a so that 

lim ^log¥„{\\Q{T)\\a+l > R) = -Oa. 

The tail exponent Oa is characterized as the solution of a 
variational problem: 

9a = inf{iJ(Al|A)/r(A) : A e [0, l]™'^™,p(A) > 1}, (38) 



Comparison. 

Putting the bounds (|32p and (|4ip together, we obtain that 



_2^2./(i+<.)(^ - p) < lim inf -- logP„ (||Q(r)||i+<, > R) 

R^oo H 

<limsupilogP„(||Q(r)||i+<, > R) 
R-^00 Ji 

1-p 

< m °+i . 

100 

For any a, ignoring small constants, the ratio between the 
two tail exponents is precisely m^. From this, we see that 
the dependence of our upper bound exponent on the load p 
is tight, when the system is heavily loaded. However, the 
dependence on the number of queues is not. 



